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METHOD AND SYSTEM FOR RECONSTRUCTING DATA 
IN A REDUNDANT ARRAY OF STORAGE ELEMENTS 

Technical Field 

The present invention relates generally to redundant array of 
inexpensive disks (RAID) methods and systems and, more particularly, to a data 
storage array method and system which accumulate a running parity of data blocks 
as the data blocks are read sequentially from respective storage elements such that 
the data blocks prior to a bad data block do not have to be reread for obtaining the 
parity information needed to complete the reconstruction of the bad data block. 

Background Art 

A data storage array is a collection of storage elements that are 
accessible by a host computer as a single storage unit. The individual storage 
elements can be any type, or a combination of types, of storage devices such as, 
hard disk drives, semiconductor memory, optical disks, magnetic tape drives, and 
the like. The individual storage elements may also be a track in a single magnetic 
tape. 

A data storage array includes a collection of storage elements and 
a controller. The controller controls the operation of the storage elements and 
presents them as a single storage unit to a host computer. The host computer 
typically executes an operating system and application programs . A virtual storage 
element is an abstract entity realized by the controller and the data storage 
elements. A virtual storage element is functionally identical to a single physical 
storage element from the standpoint of the host computer. 



99-051 -TAP 



One such data storage arrays is a redundant array of independent 
disks (RAID) or tapes (RAIT). RAID comes in various operating levels which 
range from RAID level 0 (RAID-0) to RAID level 6 (RAID-6). Additionally, 
there are multiple combinations of the various RAID levels that form hybrid RAID 
5 levels such as RAID-5 + , RAID-6 + , RAID- 10, RAID-53 and so on. Each RAID 
level represents a different form of data management and data storage within the 
RAID disk array. 

In a RAID-4 array, data is generally mapped to the various physical 
storage elements in data "stripes" across the storage elements and vertically in a 

10 "block" within a single storage element. To facilitate data storage, a serial data 
stream is partitioned into data blocks. Each data block is stored on a different 
storage element as the data blocks are striped across the storage elements. Once 
all the storage elements in a data stripe have been given data blocks, the storage 
process returns to the first storage element in the data stripe, and stripes data 

15 blocks across all the storage elements again. 

In a RAID-4 array, data consistency and redundancy is assured 
using parity data that is striped to one of the storage elements. Specifically, a 
RAID-4 array contains N-l data storage elements and a parity storage element. 
Each data stripe contains N-l data blocks and one parity block. N-l data blocks 
20 are striped to respective N-l data storage elements and a parity block is striped to 
the parity storage element. The process then continues for the next data stripe. 

RAID-4 parity is generated using an exclusive OR (XOR) function. 
In general, parity data is generated by taking an XOR function of the data blocks 
within a given data stripe. Using the parity information, the contents of any block 
25 on any single one of the storage elements in the array can be regenerated from the 
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contents of the corresponding blocks on the remaining storage elements in the 
array. Consequently, if the XOR of all corresponding blocks in the data stripe, 
except one is computed, the result is the remaining block. Thus, if data storage 
element one in the storage element array should fail, for example, the data block 
5 it contains can still be delivered to applications by reading corresponding blocks 
(data and parity) from all the surviving storage elements and computing the XOR 
of their contents. As such, the RAID-4 array is said to be fault tolerant, i.e., the 
loss of one storage element in the array does not impact data availability. 

In a data storage array, the controller accumulates parity as the data 
10 blocks are sequentially written from the host computer to the storage elements. 
When all of the data blocks in a data stripe have been written to respective data 
storage elements, the controller writes the parity block to the parity storage 
element. The controller then reinitializes and starts accumulating parity again for 
the next data stripe to be written to the storage elements. This continues until all 
15 of the data blocks have been written to the storage elements. 

During normal reading operation, the controller sequentially passes 
the data blocks to the host computer from the storage elements and discards the 
parity blocks. If a read error occurs such that a data block is unreadable, the 
controller returns to the storage element having the first data block in the data 

20 stripe and then sequentially rereads the data blocks prior to the bad data block. 
The controller accumulates parity for the reread data blocks. The controller then 
skips the bad data block and continues sequentially reading the remaining data 
blocks and the parity block in the data stripe. The controller then reconstructs the 
bad data block from three factors. These factors are the parity of the data blocks 

25 prior to the bad data block, the data blocks after the bad data block, and the parity 
block. 
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A problem with rereading the data blocks prior to the bad data block 
for reconstructing the bad data block is that this operation is time consuming. 
What is needed is a data storage array method and system for accumulating the 
parity of data blocks during sequential reading. Thus, it would not be necessary 
5 to reread the data blocks prior to a bad data block as the controller would already 
have the information (parity of the data blocks already read) needed to complete 
the reconstruction of the bad data block. 

Summary of the Invention 

Accordingly, it is an object of the present invention to provide a 
10 data storage array method and system which accumulate parity of blocks as the 
blocks are sequentially read from respective storage elements such that the blocks 
prior to a bad data block do not have to be reread for obtaining the parity 
information needed to complete the reconstruction of the bad data block. 

It is another object of the present invention to provide a data storage 
15 array method and system in which a controller accumulates a running parity of 
blocks as the blocks are sequentially read from magnetic tape to obtain the parity 
information needed to complete the reconstruction of a bad data block. 

It is a further object of the present invention to provide a data 
storage array method and system which accumulate parity of data blocks as the 
20 data blocks are sequentially read from respective storage elements such that the 
data blocks prior to a bad data block do not have to be reread for obtaining the 
parity information needed to complete the reconstruction of the bad data block. 
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In carrying out the above objects and other objects, the present 
invention provides a method for reading data blocks in a data storage array having 
data storage elements and a parity storage element. Each of the data storage 
elements store a respective data block and the parity storage element stores a parity 
5 block. The parity block is based on the data blocks . The method includes reading 
blocks sequentially from respective storage elements. Any bad data blocks are 
determined as the data blocks are being read. Parity of the good data blocks is 
then accumulated as the data blocks are being read. The parity block is then read 
from the parity storage element. A bad data block is then reconstructed from the 
10 accumulated parity of the data blocks and the parity block. 



In carrying out the above objects and other objects, the present 
invention provides another method for reading data blocks. This method includes 
reading data blocks sequentially from respective data storage elements. Any bad 
data blocks are determined as the data blocks are being read. Parity of the good 
15 data blocks is then accumulated as the data blocks are being read. The parity 
block is then read from the parity storage element. A bad data block is then 
reconstructed from the accumulated parity of the good data blocks and the parity 
block. 



Preferably, accumulating parity of the data blocks includes exclusive 
20 ORing the parity of the good data blocks read prior to the current good data block 
being read with the current good data block being read. Reconstructing a bad data 
block includes exclusive ORing the parity of the good data blocks with the parity 
block. The method preferably further includes storing the good data blocks read 
after the bad data block until the bad data block is reconstructed to preserve 
25 ordering of the data blocks during reading. 
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In carrying out the above objects and other objects, the present 
invention further provides a data storage array for reading data blocks. The 
system includes data storage elements each storing a respective data block and a 
parity storage element storing a parity block based on the data blocks. A 
5 controller sequentially reads data blocks and the parity block from respective 
storage elements. The controller determines if any of the data blocks are bad as 
the data blocks are being read. A parity accumulator accumulates parity of the 
good data blocks as the controller reads the data blocks until the controller 
determines one of the data blocks to be bad. The controller reconstructs a bad data 
10 block from the accumulated parity of the good data blocks and the parity block. 
The storage elements are preferably either magnetic tape drives, magnetic disk 
drives, or a single track of a magnetic tape. 

The advantages accruing to the present invention are numerous. 
For instance, the present invention allows higher speed operation in the event of 
15 read errors. Additional buffer bandwidth is not required as determining the 
accumulated or partial parity of the blocks is the same information that is 
performed during writing. 

The above objects and other objects, features, and advantages of the 
present invention are readily apparent from the following detailed description of 
20 the best mode for carrying out the present invention when taken in connection with 
the accompanying drawings. 
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Brief Description of the Drawing s 

FIG. 1 illustrates a block diagram of a conventional data storage 

array system; 

FIG. 2 illustrates a conventional data striping format for a RAID-4 
5 storage element array; 

FIG. 3 illustrates a data storage array system in accordance with the 
present invention; 

FIG. 4 illustrates a flow chart showing operation of the method and 
system of the present invention; and 

10 FIG. 5 illustrates a data storage array system in accordance with an 

alternate embodiment of the present invention. 

Best Modes For Carrying Out The Invention 

Referring now to FIG. 1, a data storage array system 10 containing 
a host computer 12 and a plurality of individual storage elements 14a, 14b, 14c, 
15 and 14d is shown. Host computer 12 executes, on one or more processors, an 
operating system as well as various applications that periodically read and write 
information from and to the storage elements. For simplicity, the combination of 
the operating system and applications shall be referred to as the operating 
environment. The operating environment accesses various ones of the storage 
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elements as if the individual storage elements functioned as a single, large storage 
element. 

Typically, the storage elements are inexpensive hard disk drives 
arranged in an array. Various other forms of data storage elements may be 
5 substituted for, or combined with, the disks. Such other forms of storage elements 
include, but are not limited to, optical drives, ZIP drives, floppy disk drives, 
semiconductor memory devices, magnetic tape drives, or any other form of 
random access memory. Although any of these other forms of storage elements 
may be used with the present invention, the following discussion refers to a single 
10 track of a single magnetic tape, i.e., single tape RAIT. 

When using a single magnetic tape, the operating environment treats 
the single track 14 of the magnetic tape (shown in FIG. 3) commonly referred to 
as a virtual tape 16. The data blocks are represented to host computer 12 as being 
stored in virtual tape 16 in serial fashion. Thus, the operating environment 
15 requests data from virtual tape 16 using a convenient single address. A controller 
18 ensures that the address into virtual tape 16 is mapped to an address within the 
single track of the magnetic tape. Controller 18 can also reside within host 
computer 12. 

In a redundant array of independent storage devices, such as disks 
20 or tapes, the physical storage units 14a, 14b, 14c, and 14d, known as members, 
are accessed via controller 18. Data blocks are distributed, or striped, serially 
amongst members 14a, 14b, 14c, and 14d. To achieve fault tolerance, the data 
blocks are arranged into redundancy groups where the data blocks within a data 
stripe are self consistent with the other data blocks in the data stripe. One 
25 technique for making the data stripe redundant is to use a parity block based on the 
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data blocks. As such, the redundancy information is a parity block in which the 
data blocks in the data stripe are XOR (exclusive OR) consistent. 

FIG. 2 depicts a conventional data striping format for a RAID -4 
storage element array. Under the RAID-4 standard, data blocks appearing in 
5 virtual track 16 are striped across the members 1-3. A parity block based on the 
data blocks is striped to member 4. Under RAID-4, the parity block is stored in 
a dedicated parity storage member. However, the parity block may be stored in 
a diagonal manner across the members as done under RAID-5. The pattern of 
storage is not important as long as the parity block locations are mappable. 
10 Consequently, controller 1 8 knows where the parity blocks are stored such that the 
parity blocks can be easily identified. 

Use of parity blocks to form consistent data stripes is well-known 
in the art and a description regarding the use of parity information in a RAIT-4 
storage array system will clarify operation of the present invention. Parity blocks 

15 are generated by using an exclusive OR (XOR) function upon a series of data 
blocks located within a given data stripe 20. For example, in FIG. 2, parity block 
#1 is formed by applying the XOR function to data block #1 through data block #3 
(e.g., data block #1 © data block #2 © data block #3 = parity block #1). 
Similarly, in data stripe 22, data block #4 © data block #5 © data block #6 = 

20 parity block #2 and so on. Thus, each data stripe is XOR consistent. 

If one of the members ceased to function, the information contained 
in the remaining members is used to reconstruct the data block on the damaged 
member. For example, if member 2 were damaged, data block #2 in data stripe 
20 would be unreadable. However, data block #2 = data block #1 © data block 
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#3 © parity block #1. Thus, the array is fault tolerant, i.e., if one member is 
damaged at a given time the system is still operational without any loss of data. 

Referring now to FIGS. 3-4, with continual reference to FIGS. 1-2, 
the data storage array method and system of the present invention will be 
5 described. Data storage array system 30 includes a host computer 12, a single 
magnetic tape storage element 14, and a controller 18. Controller 18 is operable 
to serially write data blocks and parity blocks from host computer 12 onto a track 
of magnetic tape 14. Controller 18 is also operable to sequentially read data 
blocks and parity blocks from a track of magnetic tape 14 for host computer 12. 

10 Controller 18 includes a buffer 32 and a parity accumulator 34. 

Parity accumulator 34 accumulates parity as controller 18 sequentially writes the 
data blocks from host computer 12 to magnetic tape 14 via buffer 32. After 
controller 18 sequentially writes all of the data blocks in a data stripe to magnetic 
tape 14, the controller writes the parity block from parity accumulator 34 to the 

15 magnetic tape. Parity accumulator then reinitializes and starts accumulating parity 
again for the next data stripe to be written to magnetic tape 14. This continues 
until controller 18 has written all of the data blocks to the single track of magnetic 
tape 14. 

During reading, controller 18 serially passes the data blocks to host 
20 computer 12 from magnetic tape 14 via buffer 32. Controller 18 discards the 
parity block belonging to a data stripe after sequentially passing all of the data 
blocks in the data stripe to host computer 12. Controller 18 sequentially reads the 
data blocks and determines if any one of the data blocks are bad before passing the 
data blocks to host computer 12. If the data block is good, controller 18 passes the 
25 good data block to host computer 12. If the data block is bad, controller 18 
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reconstructs the bad data block to make it a good data block before passing it and 
any other good data blocks to host computer 12. 

The procedure for reconstructing a bad data block into a good data 
block in accordance with the present invention will now be explained in greater 

5 detail. While controller 18 reads a data block, parity accumulator 34 accumulates 
the parity of the data blocks up to and including the current data block being read. 
For instance, if controller 18 has read data block #1 and is now reading data block 
#2, parity accumulator 34 accumulates the parity of data blocks #1 and #2 (e.g., 
accumulated parity = data block #1 © data block #2). Similarly, if controller 18 

10 is reading data block #4, the first data block in data stipe 22, and has not read any 
other data blocks in data stripe 22, then parity accumulator 34 accumulates the 
parity of data block #4 (e.g., accumulated parity = data block #4). The 
accumulated parity is the partial parity of all of the blocks in a data stripe, i.e. , the 
parity of the blocks in a data stripe that have been read. 

15 When controller 18 determines that a data block is unreadable or 

bad, the controller skips the bad data block and continues sequentially reading the 
remaining data blocks and the parity block in the data stripe. Controller 18 then 
reconstructs the bad data block from two factors. The first factor is the 
accumulated parity of the good data blocks of the data stripe read by controller 18. 

20 Parity accumulator 34 accumulates and maintains the accumulated parity of the 
good data blocks as the data blocks are being read. The second factor is the parity 
block of the data stripe. 

For instance, if a data stripe being read has six data blocks and one 
parity block and if data block #3 is bad, then controller 18 reconstructs data block 
25 #3 in accordance with the following equation: data block #3 = accumulated parity 
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© parity block #1 , where accumulated parity = data block #1 © data block #2 © 
data block #4 © data block #5 © data block #6. 

Buffer 32 stores the good data blocks read by controller 18 after the 
bad data block. After controller 18 reconstructs the bad data block and passes it 
5 to host computer 12, the controller directs buffer 32 to pass the stored good data 
blocks to host computer 12 in the order that they were read by the controller. This 
preserves data block ordering. 

Referring now to FIG. 4, with continual reference to FIGS. 1-3, a 
flow chart 40 illustrating operation of the data storage array method and system of 

10 the present invention are shown. Flow chart 40 initially begins with controller 18 
reading the data blocks sequentially from magnetic tape 14 as shown in box 42. 
Controller 18 then determines if any of the data blocks are bad as the data blocks 
are being read as shown in box 44. Parity accumulator 34 accumulates parity of 
the good data blocks as the data blocks are being read as shown in block 46. 

15 Controller 18 then sends the good data blocks prior to a bad data block to host 
computer 12 as shown in box 47. 

Controller 18 then reads the parity block from magnetic tape 14 as 
shown in box 48. Controller 18 then reconstructs a bad data block from the 
accumulated parity of the good data blocks and the parity block as shown in box 
20 50. Controller 18 then sends the reconstructed data block to host computer 12 as 
shown in box 52 and then sends the good data blocks after the reconstructed data 
block to host computer 12 as shown in box 54. 

Referring now to FIG. 5 with reference to FIGS. 1-3, an alternative 
embodiment of the data storage array system in accordance with the present 

-12- 



99-051-TAP 



invention is shown. Data storage array system 60 differs from data storage array 
system 30 shown in FIG. 3 in that separate and distinct storage elements 62a, 62b, 
62c, and 62d have been substituted for magnetic tape 14. Storage elements 62 may 
be disk drives, tape drives, and the like. Storage elements 62 are connected in 
parallel to controller 18 for concurrent access with the controller. Controller 18 
writes to and reads from storage elements in the same manner as described with 
reference to the track of magnetic tape 14 in FIG. 3. 

Thus it is apparent that there has been provided, in accordance with 
the present invention, a data storage array method and system that fully satisfy the 
objects, aims, and advantages set forth above. While the present invention has 
been described in conjunction with specific embodiments thereof, it is evident that 
many alternatives, modifications, and variations will be apparent to those skilled 
in the art in light of the foregoing description. Accordingly, it is intended to 
embrace all such alternatives, modifications, and variations as fall within the spirit 
and broad scope of the appended claims. 
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What Is Claimed Is : 



1 1 . In a data storage array having data storage elements and a parity 

2 storage element, wherein each of the data storage elements store a respective data 

3 block and the parity storage element stores a parity block, the parity block being 

4 based on the data blocks, a method for reading data blocks, the method 

5 comprising: 

6 reading data blocks sequentially from respective data storage 

7 elements; 

8 determining if any of the data blocks are bad as the data blocks are 

9 being read; 

10 accumulating parity of the good data blocks as the data blocks are 

11 being read; 

12 reading the parity block from the parity storage element; and 

13 reconstructing a bad data block from the accumulated parity of the 

14 good data blocks and the parity block. 

1 2. The method of claim 1 wherein: 

2 accumulating parity of the good data blocks includes exclusive 

3 ORing the parity of the good data blocks read prior to the current good data block 

4 being read with the current good data block being read. 

1 3 . The method of claim 2 wherein: 

2 reconstructing a bad data block includes exclusive ORing the 

3 accumulated parity of the good data blocks with the parity block. 

1 4. The method of claim 1 further comprising: 
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2 storing the good data blocks read after the bad data block until the 

3 bad data block is reconstructed to preserve ordering of the data blocks during 

4 reading. 

1 5. A data storage array system for reading data blocks , the system 

2 comprising: 

3 data storage elements each storing a respective data block; 

4 a parity storage element storing a parity block based on the data 

5 blocks; 

6 a controller for reading data blocks sequentially from respective data 

7 storage elements and the parity block, the controller operable for determining if 

8 any of the data blocks are bad as the data blocks are being read; and 

9 a parity accumulator for accumulating parity of the good data blocks 

10 as the controller reads the data blocks, wherein the controller reconstructs a bad 

11 data block from the accumulated parity of the good data blocks and the parity 

12 block. 

1 6. The system of claim 5 wherein: 

2 the parity accumulator accumulates parity of the good data blocks 

3 as the data blocks are being read by exclusive ORing the accumulated parity of the 

4 good data blocks read prior to the current good data block being read with the 

5 current good data block being read. 

1 7. The system of claim 6 wherein: 

2 the controller reconstructs a bad data block by exclusive ORing the 

3 accumulated parity of the good data blocks with the parity block. 

1 8. The system of claim 5 further comprising: 
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2 a buffer for storing the good data blocks read by the controller after 

3 the bad data block until the controller reconstructs the bad data block to preserve 

4 ordering of the data blocks during reading. 

1 9. The system of claim 5 wherein: 

2 the storage elements are magnetic tape drives. 

1 10. The system of claim 5 wherein: 

2 the storage elements are magnetic disk drives. 

1 11. The system of claim 5 wherein: 

2 the storage elements are a track of a magnetic tape. 

1 12. In a magnetic tape having data blocks and a parity block 

2 serially arranged, the parity block being based on the data blocks, a method for 

3 reading data blocks, the method comprising: 

4 reading data blocks sequentially from the magnetic tape; 

5 determining if any of the data blocks are bad as the data blocks are 

6 being read; 

7 accumulating parity of the good data blocks as the data blocks are 

8 being read; 

9 reading the parity block from the magnetic tape; and 

10 reconstructing a bad data block from the accumulated parity of the 

11 data blocks and the parity block. 

1 13. The method of claim 12 wherein: 
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2 accumulating parity of the good data blocks includes exclusive 

3 ORing the parity of the good data blocks read prior to the current good data block 

4 being read with the current good data block being read. 

1 14. The method of claim 13 wherein: 

2 reconstructing a bad data block includes exclusive ORing the parity 

3 of the good data blocks with the parity block. 

1 15. The method of claim 12 further comprising: 

2 storing the good data blocks read after the bad data block until the 

3 bad data block is reconstructed to preserve ordering of the data blocks during 

4 reading. 

1 16, A data storage array system for reading data blocks, the 

2 system comprising: 

3 magnetic tape having data blocks and a parity block based on the 

4 data blocks; 

5 a controller for reading data blocks sequentially from the magnetic 

6 tape and for reading the parity block from the magnetic tape, the controller 

7 operable for determining if any of the data blocks are bad as the data blocks are 

8 being read; and 

9 a parity accumulator for accumulating parity of the good data 

10 blocks as the controller reads the data blocks, wherein the controller reconstructs 

11 a bad data block from the accumulated parity of the good data blocks and the parity 

12 block. 

1 17. The system of claim 16 further comprising: 
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2 a buffer for storing the good data blocks read by the controller after 

3 the bad data block until the controller reconstructs the bad data block to preserve 

4 ordering of the data blocks during reading. 
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Abstract 

A RAID or RAIT type data storage array such as a single tape RAIT 
includes storage elements storing data blocks and a parity block based on the data 
blocks. The array reads the data blocks sequentially from respective storage 
devices. The array determines if any of the data blocks are bad as the data blocks 
are being read. The array accumulates the parity of good data blocks as the data 
blocks are being read. A bad data block is reconstructed from the accumulated 
parity of the good data blocks and the parity block. 
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